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In this work we study numerically the out of equilibrium dynamics of the Hopfield model for 
associative memory inside its spin-glass phase. Besides its interest as a neural network model it can 
also be considered as a prototype of fully connected magnetic systems with randomness and frus- 
tration. By adjusting the ratio between the number of stored configurations p and the total number 
of neurons A'^ one can control the phase-space structure, whose complexity can vary between the 
simple mean-field ferromagnet (when p = 1) and that of the Sherrington-Kirkpatrick spin-glass 
model (for a properly taken limit of an infinite number of patterns). In particular, little attention 
has been devoted to the spin-glass phase of this model. In this work we analyse the two-time 
auto-correlation function, the decay of the magnetization and the distribution of overlaps between 
states. The results show that within the spin-glass phase of the model the dynamics exhibits ageing 
phenomena and presents features that suggest a non trivial breaking of replica symmetry. 
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In recent years the ofF-equilibrium dynamics of spin- 
glasses below the freezing temperature has been the sub- 
ject of a great number of studies in the field of complex 
magnetic systems [Q, both experimental and theoretical. 
Real spin-glasses are characterized by such an extremely 
slow dynamics that they may never attain equilibrium 
within experimental time scales. Under these circum- 
stances a theoretical description of the actual physics of 
real spin-glasses requires a dynamical approach. 

Statistical physics models, despite their simplifications, 
have shown to be very useful in the understanding of 
the behaviour of these materials. Among them, perhaps 
the most relevant one in the development of this sub- 
ject, is the well known Edwards-Anderson model. Since 
a complete analytical description of this model has not 
be achieved up to now (due to the enormous mathemat- 
ical difficulties involved), numerical simulations emerged 
as the main tool of research in this area. However, 
in order to implement them, it is necessary to provide 
the system with an adequate dynamics, usually accom- 
plished by means of a stochastic (Monte Carlo) process. 
Although these ad-doc dynamics were originally intro- 
duced to compute equilibrium quantities, quite surpris- 
ingly they have also proved to be very useful in simulating 
the actual dynamical processes observed in real materials 

. This agreement opened up a whole new range of pos- 
sibilities in statistical physics research by allowing physi- 
cists to simulate, with simple models and Monte Carlo 
dynamics, the complex out of equilibrium behaviour of 
spin-glasses and other magnetic materials. 



Concerning equilibrium properties, the long range ver- 
sion of the EA model due to Sherington and Kirkpatrick 
(SK model), has raised particular interest owing to 
the fact that an exact solution is known for its thermo- 
statics Ql and insightful approximations have been found 
even for its dynamics The picture that emerges for 
this model is that of a phase space with a very intricate 
hierarchical structure of basins, whose number and depth 
diverge with the size of the system — as depicted by the 
solution due to G. Parisi [Q. 

Moreover, within each of those basins, which divide 
the system in independent ergodic components, there is 
as well a complex structure of subvalleys within subval- 
leys separated by barriers with a continuous distribution 
of heights. Within the framework of this complicated 
phase-space geometry the ensuing dynamics turns out 
to be of an extremely slow character and a wide range of 
new time dependent phenomena are observed, which col- 
lectively are referred to as ageing phenomena. Starting 
from random initial conditions such a system may never 
achieve true equilibrium; therefore, its inherent physics 
must be interpreted as dynamical in nature. Whether 
this picture is shared by low dimensional systems or not, 
is still under enduring discussions. 

The Hopfield model of neural networks has been thor- 
oughly studied in connection with its static and dynam- 
ical properties of retrieval, which together determine its 
usefulness as an associative memory model. Besides its 
value as a neural model it is possible to look upon the 
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Hopfield model in the broader context of complex mag- 
netic systems. In this sense, we can consider it as an- 
other kind of long-range spin-glass model with a differ- 
ent choice of coupling distribution, and with the added 
advantage of having a phase-space structure whose com- 
plexity can be controlled. Both static and dynamical 
studies of the Hopfield model have concentrated mainly 
on the retrieval phase and close to the basin of attrac- 
tion of a stored memory pattern; consequently, in such 
circumstances, the very rich spin-glass structure underly- 
ing the free-energy landscape has received little attention 
so far. 

The thermostatics of the Hopfield model has been com- 
pletely solved assuming that replica symmetry holds. 
While this seems to be the correct solution within the re- 
trieval zone (except for very low temperatures Q), it has 
not been obvious until now, as far as we know, which sym- 
metry breaking scheme yields the correct solution within 
the spin-glass phase of the model. 

In particular, some corrections, due to symmetry 
breaking effects, have been found at very low temper- 
atures 0]; nonetheless, it has always been sustained that 
the influence on the retrieval capabilities of the network, 
induced by a breaking in replica symmetry, do not have 
any noticeable effect on the retrieval performance of the 
system [||. 

The main objective of this paper is twofold. First, to 
get insight into the underlying structure of the spin-glass 
phase of the Hopfield model. This will eventually help to 
find the correct Ansatz to solve its thermodynamics. On 
the other hand, since it is possible to control the rich- 
ness of its phase-space structure, ranging from a simple 
ferromagnet, when only one pattern is stored, to the SK 
at the other extreme for a properly taken limit of an in- 
finite number of patterns |8| , it will allow us to extract 
important conclusions concerning the influence of such 
structure on the off-equilibrium dynamics of magnetic 
systems. 

The outline of this paper is as follows: first we de- 
scribe the model we used and the methods of our simu- 
lations. Then we present the results and their interpre- 
tation within the framework of long-range spin-glasses, 
and finally we discuss our conclusions and suggest further 
paths of research on the subject. 

I. MODEL 

The Hopfield model of neural networks is described by 
the following Hamiltonian ||T^ : 

where the sum goes over all the possible pairs The 
variable Si represents the state of the \-th Ising spin (neu- 



ron) at the discrete time t, and Jy is the coupling con- 
stant between the i-th and the j-th neurons. The cou- 
pling matrix J is built according to Hebb's rule in order 
to store a definite set of p randomly chosen configurations 
(patterns): 



where we denote each of the p patterns as = {ff } 
[ji = 1 . . .p^i = 1 . . . N , where N is the total number of 
spins) . 

The time evolution of the model is governed by a stan- 
dard heat-bath Monte Carlo process with sequential up- 
date, and we say that it performs as an associative mem- 
ory system if each of the p stored patterns is close enough 
to an attractor of the dynamics. In fact, when this hap- 
pens the structure of the phase space is fairly complex, as 
a huge number of other attractors also appear alongside 
The simplest of them are the reverse states, i.e., the 
actual patterns with all the spins inverted. Other states 
which are stable points of the dynamics are the spurious 
attractors (mixture states) and the spin-glass states. A 
complete solution of the model can be found in Q and we 
reproduce in Fig. I the phase diagram obtained therein. 

The labeled curves delineate the borders of qualita- 
tively differentiated regimes of the Hopfield model in the 
T ~ a plane, where a = p/N . All over the roughly trian- 
gular sector enclosed by the r/\/ line, the stored patterns 
are close to dynamical attractors, therefore the system 
performs well as an associative memory device. Still, we 
need to discriminate between two distinct zones associ- 
ated with the retrieval sates which differ in their phase- 
space structure. Inside the region below the Tc line, the 
retrieval attractors represent absolute minima of the free 
energy. A different structure is found in the region be- 
tween the Tc and the Tm lines where the global minima 
correspond to spin-glass states totally uncorrelated with 
the patterns. However, the retrieval attractors still stand 
as local minima of the free energy, thus allowing the sys- 
tem to work as an associative memory as long as the 
dynamics is initiated close enough to a retrieval basin. 
Then, as the Tm line is crossed the retrieval states disap- 
pear abruptly and the spin-glass states become the only 
ones present. This spin-glass phase covers all the region 
beyond the Tj\/ line and below Tg — the latter having a 
simple mathematical expression, namely: Tg — 1 + ^/a. 
Finally, above Tg all the free-energy structure is lost as 
the system enters a paramagnetic phase. The line labeled 
Tr shows the limit of validity of the replica-symmetry 
Ansatz. 
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FIG. 1. Phase diagram for the Hopfield modeL See the 
main text for a brief explanation. After Amit et al [6] 

We performed simulations on systems with a number 
of spins ranging between 128 and 4000, with particular 
emphasis in iV = 500 and N — 1000. Throughout this 
work the time is measured in units of whole Monte Carlo 
sweeps over the network of N spins. 



II. RESULTS 

In this section we present and describe the results of 
our simulations for a range of values of the parameter a, 
covering the spin-glass phase of the Hopfield model . 



A. Ageing 

In attempting to characterize the dynamics of the 
model, we first carried out some numerical experiments 
focused on revealing the presence of slow dynamics 
in conjunction with history-dependent phenomena, i.e., 
ageing. These features are most easily found numerically 
in simulations concerning the two-time auto-correlation 
function C{t^t'), which turns out to show a strong ex- 
plicit dependence on both times over a wide range of time 
scales. For a system that has achieved equilibrium it is 
expected that C{t,t') is homogeneous in time, depend- 
ing on t and t' only through their difference. However, in 
spin-glass systems in their glassy phase exhibiting ageing 
phenomena, a much more complicated behaviour arises 
which reveals the basis for the scenario that has been 
called weak ergodicity breaking (WEB) Jl3t . In the realm 
of long-range spin-glasses the onset of slow dynamics and 
history-dependent phenomena below a definite transition 
temperature, is normally associated with a highly com- 
plex free-energy surface with a plethora of metastable 
states. In a system evolving through an energy landscape 
so complex as that found in long-range spin-glasses, the 
many basins within basins may play the role of dynamical 
traps which, having a continuous distribution of heights 



without bounds, can thereby confine the system in such 
a way that the average escape-time goes to infinity. 

We can write down the basic features of the WEB sce- 
nario more explicitly, regarding the behaviour observed 
in the two-time auto-correlation function, as follows: 



at 
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> 



limt^oo C{t^,t + t^) =Q 
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(3) 



where i^, indicates the time that the system has been left 
to evolve after a sudden quench from infinite temperature 
to a low temperature state, and t is the time measured 
since the waiting time tw- 
in all our simulations we chose a set of p random pat- 
terns, where each of the ^["s is taken from the following 
distribution: 



i(<5(er-i)+5(er + i)) 



(4) 



In order to take measurements of the two-time auto- 
correlation function we computed numerically the follow- 
ing expression: 



1 ^ 

City,,t + tw)= [— ^S'.(U)S',;(t-f t^) 



(5) 



where we have denoted by [. . .]av an average taken over 
several realizations of the random patterns and thermal 
baths. The abrupt quench from infinite temperature to 
the glassy phase was emulated by always starting our 
simulations from random initial configurations. 

In many occasions in this paper we shall refer to the 
SK model for comparison, and consequently we have in- 
cluded in Figure 2 the results of a simulation carried out 
on that model — which although performed by us for this 
work, it is a result that had already been reported in 
the literature ||lj]. This figure corresponds to a system 
with N = 1000 spins and with couplings taken from a 
Gaussian distribution normalized so that Tg = 1. In this 
case the temperature of the thermal bath was chosen as 
T = 0.4Tg. The graph shows C(i^, t + t^j) vs. t for dif- 
ferent waiting times ranging from = 2 to i^, = 8192. 

The first result for the Hopfield model is shown in 
Fig. 3, and it pertains to a system with = 1000, 
a ~ I and T = 0.4Tg; inside the spin-glass phase and 
far enough from the Tm line to avoid strong size effects. 
The behaviour of the auto-correlation function confirms 
clearly the presence of ageing in the Hopfield model in 
this region, in agreement with the WEB picture described 
by Eqs. (|). The curves show an explicit dependence on 
both times indicating that equilibrium has not been at- 
tained within the time of the simulation. Furthermore, 
its decay becomes slower for longer waiting times as it is 
expected within the context of ageing phenomena. It is 
worth noticing that the qualitative features of the graph 
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arc roughly similar to those found in the SK model, in 
particular for the longest waiting times. 




FIG. 2. Two-time auto-correlation functions C{tw,t + tw) 
vs. t for the SK model, with N = 1000, at T = OATg and with 
couplings taken from a Gaussian distribution. The waiting 
times are: 2, 8, 32, 128, 512, 2048, 8192. The exhibited data 
arc an average over 400 realizations of the couplings, initial 
conditions and thermal baths. 




FIG. 3. Two-time auto correlation functions C{tyj,t + tw) 
vs. t for the Hopfield model, with N = 1000, at T = O.4T9 and 
Q = 1. The waiting times are: 2, 8, 32, 128, 512, 2048, 8192. 
The exhibited data are an average over 200 realizations of the 
set of memory patterns, initial conditions and thermal baths. 

From the standpoint of this result it is expected that 
similar features of ageing are found for larger values of 
a, since we know that for a ^ 00 the Hopfield model 
converges to the SK model. A more delicate point to 
be concerned with refers to the behaviour of the Hop- 
field model in regions of its spin-glass phase closer to the 
retrieval zone. To address that issue we studied the dy- 
namics of the model for a value of a = 0.2, which is close 
to the retrieval zone and at the same time lies at a safe 
distance from the critical Tm transition line, whose exact 
location shifts towards larger values of a due to finiteness 



of the system. Besides, we had to deal with other man- 
ifestation of finite size effects, in this case related to the 
less degreee of frustration in the couplings as the value 
of a is lowered. It is worth stressing that this strong 
dependence on N was not observed for larger values of 
a (see below). This can be easily understood in the fol- 
lowing terms: higher values of a imply more frustration 
in the couplings, and so higher energy barriers between 
metastable states. For small values of a the system can 
then quickly thermalize, and the time it requires for ther- 
malizing depends strongly on N. On the other hand, for 
large values of a the sizes of the energy barriers make 
the thermalizing time increase far beyond our simulation 
times and therefore we observe non-equilibrium phenom- 
ena that do not depend on the size of the system. 

To analyse the finite size effects, we carried out sim- 
ulations with system sizes ranging from N = 500 to 
N = 4000. In Fig. 4 we show C{tyj,t + t^) vs. t for 
= 128 and N = 500, 1000, 2000, 4000 (hollow sym- 
bols from top downwards), where we see that even for 
the largest size we considered the dependence on N is 
still strong. Since larger systems are beyond our com- 
putational capacity we decided to extrapolate the data 
to TV 00, assuming that the CN{tw,t + ty,) varies 
smoothly with 1/A'', and keeping terms up to second or- 
der. The lowest curve (full symbols) in Fig. 4 corre- 
sponds to the extrapolated values obtained for = 128. 
In Fig. 5 we plot all the extrapolated curves C{tw, t + tw) 
vs. t. 
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FIG. 4. Two-time auto-correlation functions C{tw,t + tw) 
vs. t for the Hopfield model, with = 128, at T = 0.4Tg, 
a = 0.2 and different sizes {N = 500, 1000, 2000 and 4000 
from top downwards). The lowest curve corresponds to the 
extrapolated values. 
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In Figs. 6 and 7 we show the results for a = 10 and 
a = 100 (with N = 1000 and N = 500 respectively, since 
as a increases the results have less dependence on N). 
Let us observe that the behaviour shown by the Hopfield 
model in this range of alpha values is much alike that of 
the SK model. 



Another quite relevant issue is finding an appropriate 
scaling law for the ageing curves. As has already been 
pointed out in the literature [^|Jl^], systems that exhibit 
a continuous distribution of relaxation times, like the SK, 
may not obey a simple scaling relation. Instead, for sys- 
tems with a unique relevant time-scale (for instance, the 
p-spin model) it is possible to find simple laws that cause 
all the ageing curves to collapse into a single one. As an 
example, let us put forward the simplest of those scal- 
ings, usually called naive scaling, which takes the follow- 
ing form 1^ : 




FIG. 6. Two-time auto-correlation functions C{tw,t ~\-tw) 
vs. t for the Hopfield model, with N = 1000, at T = OATg 
and a = 10. The rest of the parameters are the same as those 
of Fig. 2 



C{t^,t + t^,)^ fi-^-) . (6) 



A likewise dependence is observed in other models that 
can be well described by theories in which full replica 
symmetry holds The graph in Fig. 8 shows C{ty,, t + 
tuj) vs. t/tm for the data displayed in Fig. 3 {a — 1), 
and brings the Hopfield model even closer to the SK, 
as it depicts exactly the same patterns found in that 
model ll^. That is, on the one hand the roughly com- 
mon crossing-point at t/t^ (with a corresponding value 
of approximately 1 — T/Tg on the auto-correlation axis); 
on the other, the dependence shown by C{tw,t -\-tyj) for 
increasing values of t^ when r = t/t^ is kept fixed: it 
increases when r > 1, whereas it decreases for r < 1. 
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FIG. 8. Two-time auto-correlation functions C{tw,t + t^) 
vs. t/tyj for the Hopfield model, with = 1000, at T = OATg 
and a — 1. The rest of the parameters are the same as those 
of Fig. 2 

The observed lack of agreement between the scaled 
curves serves as an indication of the complexity of the 
many time scales involved — as was already mentioned in 
connection with the SK model. Next we tried the follow- 
ing more complex expression, which had already been 
used on the SK model yielding a better scaling |]l2|: 



In Figs. 9-11 we have plotted C{tw,t + vs. ln{t + 
tw)/ln{tw) for a = 0.2, 1 and 10, respectively (the curves 
for a — 0.2 where obtained from the extrapolated values 
displayed in Fig. 5). By analysing the graphs, we notice 
that the data fall into two different groups, depending 
on the particular age (waiting time) of the system. In 
the first place, the curves for i^, = 2 and = 8, which 
are associated to a very young system, do not show a 
good scaling in any of the figures. On the other hand, 
the data corresponding to all the other (longer) waitings 
times are appreciably better scaled by relation |^. As re- 
gards Fig. 11 it is worth noticing that the graph bears a 
remarkable resemblance to the one obtained for the SK 
model in reference |l^ using the same scaling expres- 
sion 0. This also applies to the little departures from a 
correct superposition observed when t » 1. Thus, we 
can conclude that in the spin-glass phase we do not find 
any critical value of a (at least larger than 0.2) below 
which the replica symmetry Ansatz holds. On the con- 
trary, our evidence suggests that the spin-glass phase has 
a phase-space structure very similar to that observed in 
the Sherrington-Kirkpatrick model. 
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FIG. 9. Extrapolated two-time auto-correlation functions 
C{t-u,,t tw) vs. \n{t + tw) / \n{tw) for the Hopfield model, at 
T — OATg and a = 0.2. The rest of the parameters are the 
same as those of Fig. 2 
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FIG. 10. Two-time auto-correlation functions C(fu), i + tiu) 
vs. ln{t + 1^) / ln{t^) for the Hopfield model, with N = 1000, 
at r = OATg and a — 1. The rest of the parameters are the 
same as those of Fig. 2 




0.0 1.0 2.0 3.0 4.0 5.0 



ln(l+n 
ln(U 



6 



FIG. 11. Two-time auto-correlation functions C{tu,,t + tw) 
vs. ln{t + 1^) / ln{t^) for the Hopfield model, with N = 1000, 
at r = OATg and a = 10. The rest of the parameters are the 
same as those of Fig. 2 

B. Decay of the Magnetization 

In systems that possess a huge number of metastable 
states in the presence of quenched disorder, hke the SK, 
the decay to equihbrium of physical quantities usuaUy 
obeys power laws. We ran a series of simulations in which 
we started the Hopfield model from a totally magnetized 
state, i.e. Si{0) = 1V«, and let it relax in contact with a 
thermal bath and no external fields applied. In this case 
we monitored the quantity : 

LiV — J av 

i 

Then we fitted the obtained data with the same ex- 
pression used in (l2| : 

m{t) = moo + mt^^'-'^^ (9) 

The results of the simulations are presented in Fig. 12, 
where we have plotted S(T) vs. T for a system with 
N — 500 and a = I. The exponent turns out to be a lin- 
ear function of temperature in a striking agreement with 
the behaviour shown by the SK model . 
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FIG. 12. Magnetization-decay exponent S{T) vs. T/Tg. 
The data corresponds to a system with A'' = 500 and a — 1 

C. Distribution of Overlaps 

The overlap distribution contains much information 
regarding the geometric structure of phase space, and 
its asymptotic form may unveil a complex arrangement 
of many metastable states. We performed a numeric 
computation of the time-dependent overlap-distribution 
P{q, t). To that purpose we started randomly a set of 15 



replicas of the system and let them evolve with indepen- 
dent thermal baths and no couplings between them; at 
prescribed times we took measurements of all the possible 
overlaps between the replicas, and repeated this proce- 
dure for several realizations of the set of random patterns. 
Finally, we made a histogram with all the gathered data. 

As it evolves, each system shall probe different regions 
of the complex free-energy landscape, searching stochas- 
tically for basins of increasing depth. Hence, their mutual 
overlaps — at large times — are expected to render some 
insight into the deeper structure of phase space. The 
corresponding overlaps between each pair of replicas were 
evaluated according to the following expression: 

1 ^ 

'^"'''w = ]^E^"w^fw ' (10) 

i=l 

where the superscripts denote different replicas. The re- 
sults of this simulation can be seen on Fig. 13 and corre- 
spond to a system size of = 128 spins and T = OATg. 
As we started the replicas from random initial conditions, 
for short times the distributions must be approximately 
Gaussian. Subsequently, the nearly Gaussian shape dis- 
torts by broadening at the base, reaching an almost uni- 
form distribution for t = W (stars in the graph). From 
that time on the curve begins to develop two clearly de- 
fined peaks, which grow in height and sharpen while con- 
verging asymptotically to the final shape for long times. 
It is also interesting to notice that the data converge 
rapidly to a limiting value for q = which is different 
from zero. From the above mentioned facts we conclude 
that the distribution for t ~f oo consists of two Dirac's 
deltas (corresponding to ±qEA) plus a continuous distri- 
butions between them. This is the same result that has 
been obtained both numerically ||l^ and analytically for 
the SK model. 

The Edwards-Anderson order parameter stands a ge- 
ometric indicator that roughly establishes the size of the 
deepest basins visited by the system in its evolution. The 
usual way of estimating its value numerically is by mea- 
suring the position of the two peaks in the distribution 
P{q,t) for t — !■ oo. Hence, from the data of our simula- 
tions we obtain approximately q^^^^^ ~ 0.73. Further- 
more, we have tested this result against the value pre- 
dicted by the replica-symmetric solution of the Hopfield 
model by solving numerically the saddle-point equations 
of the calculations yielded (f'^A^^ ~ 0.6167, which 
differs considerably from the measured one and in fact 
falls quite close to the value obtained for the SK model 
within the replica symmetric approximation These 
results may be compared with the value of the order pa- 
rameter predicted by Parisi's solution of the SK model, 
which is given with good approximation by the following 
expression [|l5|: 
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'I'^r-^-li^Y- (11) 

For T/Tg = 0.4 equation yields q^^P = 0-76, in 
good agreement with our data for the Hopfield model. 
The shght discrepancy might be due to an a-dependence 
in the Hopfield model jointly with size effects. 

These facts altogether support strongly what has al- 
ready been suggested by our ageing simulations on the 
Hopfield model — that the dynamics for long times is es- 
sentially that of the SK model. 
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FIG. 13. Overlap distribution P{q, t) vs. q, for a system 
with A'^ = 128 and a = 1. The different curves correspond 
to the following times:2, 4, 8, 16, 64, 512, 4096, 32768. A total 
of 15 replicas were used in each of 744 runs with different 
realizations of the random patterns and thermal noise. 



III. CONCLUSIONS 

In our simulations we have analysed the glassy dynam- 
ics of the Hopfield model in the intermediate region be- 
tween its retrieval phase and the SK- limit for a — s- cx). So 
far, no analytical solution has been found for the model's 
dynamics that incorporates a full breaking of replica sym- 
metry; therefore, our results may shed some light in the 
asymptotic behaviour that ought to be required in ana- 
lytical treatments of the problem. 

The first and foremost conclusion is that the Hopfield 
model in its spin-glass phase — for intermediate values of 
a — shows a complex dynamics which fits neatly into the 
scenario of weak ergodicity breaking. Comparing the two- 
time auto-correlation curves found for the Hopfield and 
SK models, we conclude that for long times both systems 
behave similarly in the whole range of a's we studied. 
The numerical evidence we collected supports the con- 
clusion that the phase-space structure of the Hopfield 
model is much more complex than that expected for a 
long-range magnetic system in which replica symmetry 
holds. Likewise, the failing in trying to collapse all the 



ageing curves into a single one by means of a simple scal- 
ing law, may as well indicate the presence of a continuous 
range of temporal scales in the dynamics. 

In the intermediate region on the a scale the decay of 
the magnetization was found to obey a power law, in- 
dicating the existence of a great number of metastable 
states. In addition, the decay exponent showed a linear 
dependence on temperature, notably alike the observed 
in the SK model. This last fact let us go a step fur- 
ther and suggest a very similar organization of the vast 
collection of metastable states in the two models. 

The characteristics of the overlap distribution at long 
times contribute some important facts regarding the 
structure of the most profound basins in the free-energy 
hyper-surface. On one side we noticed the evidence 
of a continuous portion in the distribution, and on the 
other, the Edwards-Anderson order parameter that we 
obtained for the Hopfield model — for a = 1 and T = 
OATg — is very much close to the theoretical value found 
analytically from Parisi's theory for the SK model. Once 
more, these facts point at an inherent resemblance of the 
two models under comparison. 

Summing up the numerical results altogether, we have 
arrived at the following picture for Hopfield model in the 
studied range of parameters: in the spin-glass phase the 
free-energy landscape of the Hopfield model differs from 
that of the SK model mainly in the regions farthest away 
from the deepest basins, which are precisely the ones that 
a randomly started configuration is very much likely to 
visit first. Nevertheless, as the system evolves and dif- 
fuses into the rugged high-dimensional free-energy sur- 
face it encounters a geometric structure that is essentially 
the same as for the SK model. 

Among the extensions of the present work we mention 
that there are ongoing studies aimed at determining the 
nature of the a-dependence of the phase-space structure 
in the retrieval phase below the Tm transition line, where 
the simultaneous presence of different types of attractors 
may lead to the emergence of complex ageing behaviour. 
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